Universality in complex networks: random matrix analysis 
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We apply random matrix theory to complex networks. We show that nearest neighbor spacing 
distribution of the eigenvalues of the adjacency matrices of various model networks, namely scale- 
free, small-world and random networks follow universal Gaussian orthogonal ensemble statistics of 
random matrix theory. Secondly we show an analogy between the onset of small-world behavior, 
quantified by the structural properties of networks, and the transition from Poisson to Gaussian 
orthogonal ensemble statistics, quantified by Brody parameter characterizing a spectral property. 
We also present our analysis for a protein-protein interaction network in budding yeast. 
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The network concept has been gaining recognition as 
a fundamental tool in understanding dynamical behav- 
ior and response of real systems coming from different 
fields such as biology (e.g. food-web, nervous system, 
cellular metabolism, protein-protein interaction network, 
gene regulatory networks), social systems (e.g. scientific 
collaboration, citation), linguistic networks, and techno- 
logical systems (e.g. Internet, power-grid etc (for reviews, 
see, e.g., Q). 

Different models have been proposed to study and un- 
derstand systems having underlying network structures. 
Watts and Strogatz proposed an algorithm to generate 
popularly known as 'small- world network' [2], which cap- 
tures randomness (characterized by small diameter) and 
regularity (measured by clustering) of real-world net- 
works. This model emphasizes on the importance of 
random connections in networks. Barabasi and Albert 
proposed a model to capture degree distributions of real- 
world networks p|. According to this model only few 
nodes are responsible to carry the whole network. Since 
then came spurt of activities to the network studies and 
various structural properties of these model networks and 
real world networks have been studied to a great extent 

sail. 

Furthermore, there exists extensive literature demon- 
strating that the properties of networks are well charac- 
terized by the spectrum of associated adjacency matrices. 
The adjacency matrix (A) of a network is defined in the 
following way: Aij = 1 if i and j nodes are connected and 
zero otherwise. For an undirected network it is symmet- 
ric and consequently has real eigenvalues. These eigenval- 
ues give information about some basic topological prop- 
erties of underlying networks 5]. For example, spectral 
density of adjacency matrix of a random network, whose 
elements are randomly or 1, also follows the semicircu- 
lar law Interestingly, this result matches with a very 
celebrated result in RMT about the spectral density of a 
random matrix, whose elements are Gaussian distributed 
random numbers, following Wigner's semicircular law Q. 

With the increasing availability of large maps of real- 
world networks, the analysis of spectral densities of real- 
world networks and model networks having real-world 
properties have also begun @, H, [§] . These analyses show 



that the spectral densities of model networks and real- 
world networks are not semicircular, instead they have 
some specific features depending on the minute details 
of the networks . For example, small-world model net- 
works show very complex spectral densities with many 
sharp peaks, while spectral densities of scale-free model 
networks exhibit triangular distribution 0, Q . 

In this paper we study networks within the framework 
of random matrix theory (RMT). We show that there ex- 
ists one to one correlation between the network diameter 
which is a structural property and the eigenvalues fluctu- 
ations of the adjacency matrix which is a spectral prop- 
erty. We present our RMT analysis for various model 
networks studied extensively in the recent network liter- 
ature and also for a real-world network. We find that in 
spite of having differences (in terms of various local and 
global properties, which are being used to characterize 
networks) in these networks, fluctuations of the eigenval- 
ues of adjacency matrices show universal distribution. So 
far we are aware of only one relevant paper where authors 
have studied eigenvalue fluctuations in a microarray data 
for discovering functional gene modules • 

RMT was proposed by Wigner to explain statistical 
properties of nuclear spectra [7j . Later this theory was 
successfully applied in the study of spectra of different 
complex systems including disordered systems, quantum 
chaotic systems, large complex atoms, etc More 
recently, RMT is applied successfully to analyze time- 
series data of stock-market, atmosphere, human EEG, 
and many more [l^ . A popular practice in RMT is to 
study eigenvalue fluctuations via nearest neighbor spac- 
ing distribution (NNSD). NNSD is the distribution of 
spacings between consecutive eigenvalues. It follows two 
universal properties depending upon the underlying cor- 
relations among the eigenvalues. For correlated eigenval- 
ues, NNSD follows Wigner-Dyson formula of Gaussian 
orthogonal ensemble (GOE) statistics of RMT, which is 
a property shown by real symmetric random matrices 
with elements being Gaussian distributed random num- 
bers. On the other hand, for uncorrelated eigenvalues, 
NNSD follows Poisson statistics of RMT, which is a prop- 
erty shown by random matrices having nonzero elements 
only along its diagonals. 
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FIG. 1: (Color online) (a)-(b) Spectral density (p(A)) of ran- 
dom (Erdos-Renyi model) and scale-free network (following 
Ref.0]), respectively, (c)-(d) Corresponding spacing distribu- 
tion (P(s)). Both follow GOE statistics. The histograms are 
numerical results and the solid lines represent fitted Brody 
distribution. All networks have N = 2000 nodes and an aver- 
age degree k = 20 per node. Figures are plotted for average 
over 10 random realizations of the networks. 



In the present study, we find that the NNSD of random 
networks follow GOE. The spectral density of random 
networks and of Gaussian distributed random matrices 
are both semicircular, so it was expected that their spac- 
ing distributions would be identical. However, very in- 
terestingly, NNSD of scale-free networks and small-world 
networks also follow GOE statistics. In addition to these 
model networks, we also analyze a protein-protein inter- 
action network in budding yeast. We find that this real- 
world network is scale-free and its spacing distribution 
also follows GOE. 

Secondly, we study the change of NNSD with the 
transition from regular to small-world network. Watts- 
Strogatz model of small-world network is constructed by 
rewiring the edges of a regular ring lattice with probabil- 
ity p. This rewiring procedure generates a network with 
some random connections, without altering the number 
of vertices or edges. For p = 0, structure of the regular 
lattice or fc-nearest neighbor coupled network remains 
same; on the other hand, for p = 1, the regular lattice 
becomes a random network. For intermediate values of p, 
the graph is a small-world network. We find that for the 
regular lattice (p = 0), NNSD follows Poisson statistics, 
for p = 1 it follows GOE statistics and for < p < 1 it 
shows intermediate statistics of Poisson and GOE. More- 
over we show that the NNSD changes from Poisson to 
GOE with a very small increment in p, and most im- 
portantly, transition to GOE takes place exactly at the 
onset of small-world transition. We establish a relation 
between small-world transition and GOE transition by 
comparing the diameter and the clustering coefficients of 
network with the Brody parameter (3. This parameter 
comes from a semiempirical eigenvalues spacing distribu- 



tions studied extensively in RMT to model Poisson to 
GOE transition. 

Here we briefly describe some aspects of RMT which 
we use in our network analysis. We denote the eigenval- 
ues of a network by Aj, i = 1, . . . , N, where N is size of 
the network and Ai < A2 < A3 < • • ■ < A^r. In order to 
get universal properties of the fluctuations of eigenval- 
ues, it is customary in RMT to unfold the eigenvalues by 
a transformation Ai = N(Xj), where N is averaged inte- 
grated eigenvalue density Since we do not have any 
analytical form for N, we numerically unfold the spec- 
trum by polynomial curve fitting (for elaborate discussion 
on unfolding, see Ref.[7|]). After unfolding, average spac- 
ings will be unity, independent of the system. Using the 
unfolded spectra, we calculate spacings as s; = Ai+i — A;. 
NNSD is defined as the probability distribution (P(s)) of 
these s^s. In case of Poisson statistics, P(s) — exp(— s); 

whereas for GOE, P(s) = exp ( — ^f - ) ■ For intermedi- 
ate cases, th e sp acing distribution is described by Brody 
distribution [la ]: 



Pp(s) = As^exp (-as^ 1 ) 



where 



A = (1 + (3)a and a 
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This is a semiempirical formula characterized by param- 
eter (3. As (3 goes from to 1, the Brody distribution 
smoothly changes from Poisson to GOE. We fit spacing 
distributions of different networks by the Brody distri- 
bution Pp(s). This fitting gives an estimation of (3, and 
consequently identifies whether the spacing distribution 
of a given network is Poisson, GOE or intermediate of 
these two. 

In Fig. [U we present the ensemble averaged spectral 
density (p(A)) and spacing distribution (P(s)) of random 
and the scale-free networks. Figs, fflja) andQJb) respec- 
tively show the well known semicircular and triangular 
distribution of spectral densities of random and scale-free 
networks. Using RMT techniques described earlier we 
obtain spacing distributions for the unfolded eigenvalues. 
Figs. [He) andQJd) plot these distributions. Now using 
Eq. (fT|), we estimate Brody parameter as (3 ~ 1, which 
clearly shows GOE statistics of spacing distributions for 
both the networks. Following RMT, these results imply 
that even though spectral densities of scale-free networks 
are different from random networks, correlations among 
the eigenvalues of scale-free networks are as strong as 
that of the random networks. 

To show that our analysis exhibiting universality of 
GOE statistics for model random networks arc generic, 
we studied some real-world networks also and here we 
present our results for a protein- protein interaction net- 
work in budding yeast [14 ]. Results are presented in 
Fig. [21 top panel showing that the degree distribution 
p(k) of the network follows power-law, i.e., p(k) oc fc -7 , 
with 7 ~ 2.1536. Middle panel shows that the spectral 
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FIG. 2: (Color online) Figure shows different properties of 
a protein-protein interaction network in budding yeast, (a) 
Degree distribution : the scale-free nature of the network is 
clearly observed, (b) Spectral density : large value of p(0) 
(Inset : besides large p(0), overall spectral density follows 
well-known triangular distribution, (c) Spacing distribution : 
it follows GOE, estimated value of /3 is ~ 1. The histogram 
represents numerical result and the solid line is fitted Brody 
distribution given by Eq. (fjrj. 



density of this network is overall triangular (see also the 
inset of this panel for magnified figure) but with very 
large p(0). Large value of p(0) is one of the character- 
istics of many real- world networks Due to the large 
p(0), it is very difficult to numerically unfold the spec- 
tra. Therefore, in this case, we divide the spectra into 
two parts : one part contains only negative eigenvalues 
with values less than —0.1 and the other part contains 
positive eigenvalues with values greater than 0.1. We 
assume these two sets of eigenvalues as an ensemble of 
two realizations, and calculate ensemble averaged spac- 
ing distribution. Bottom panel of Fig. [2] is showing that 
the spacing distribution of this protein-protein interac- 
tion network follows GOE. We have also studied spec- 
tral rigidity of the eigenvalues spectra which show that 
these networks follow RMT predictions for sufficiently 
large scales. Also this analysis seems to characterize the 
level of randomness in network architecture (TEj l . 

Now we discuss our results for the Watts-Strogatz 
model of small-world network. In Figs. 03a) and[3]Je), we 
present respectively the spectral density and the spacing 
distribution of regular ring lattice with each node having 
20 edges. Spacing distributions are obtained again from 
the same technique. Subfigure (a) shows that the spec- 
tral density of lattice is complicated without having any 
known analytical form; but its spacing distribution (sub- 
figure (e)) clearly follows Poisson statistics (/3 ~ 0). Then 
we randomize a fraction p = 5 x 10~ 5 of the edges of regu- 
lar lattice. For this value of p, spectral density and spac- 
ing distribution are plotted respectively in Fig. E^b) and 
Fig- Elf)- These figures reveal that, for this very small 
value of p, spectral density does not show any notice- 



able change as compared to the regular lattice, whereas 
spacing distribution shows different property (f3 ~ 0.08). 
As we further increase parameter p from 5 x 10~ 5 to 
p = 2 x 10~ 4 and thereafter to p = 5 x 10~ 4 , spectral 
densities show hardly any changes in its features (Figs. 
GEc)-Eld)), but very interestingly, according to Figs. E^g) 
and[3Jh), spacing distributions show significantly differ- 
ent properties as compared to the regular lattice. Now 
these are looking like intermediate of the Poisson and 
the GOE. By fitting spacing distribution corresponding 
to these two p values with the Brody formula (Eq. [1]), we 
estimate (3 respectively as 0.63 and 0.79. These values in- 
dicate that we are already at the onset of Poisson^GOE 
transition. Note that we take regular lattice with aver- 
age degree k ~ 20 for which NNSD is showing Poisson 
statistics. For other values of k, where we may not have 
Poisson statistics, there also we get transition to GOE 
statistics. We choose k ~ 20 just to make transition to 
GOE analogy clear. Detailed analysis for other k values 
would be presented elsewhere (l6| . 

We present in Fig. [f] variation of [3 as a function of p 
over the whole range < p < I. Here we show correspon- 
dence between the Brody parameter and two important 
network parameters - the characteristic path length L(p) 
and the clustering coefficient C(p) - as a function of p. 
L measures number of connections in the shortest path 
between two nodes, averaged over all pairs of the nodes. 
Clustering coefficient C measures the cliquishness of a 
typical neighborhood, averaged over all nodes. In this 
figure we have normalized L and C by values L(0) and 




FIG. 3: (Color online) Figure shows the transition from ring 
regular lattice to the small-world network, (a)-(d) show the 
spectral densities and (e)-(h) show the corresponding spacing 
distributions for p = 0, 5 x 10" 5 ,2 x 10~ 4 ,5 x 10 -4 , respec- 
tively. The histograms are numerical data and the solid lines 
are the corresponding fitted Brody distribution (Eq. [TJ. See 
text for the corresponding values of Brody parameters. All 
the networks have N — 2000 nodes and k = 40 average degree 
per node, and data are average over 10 random realization of 
the rewiring process. 
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FIG. 4: (Color online) The shifted Brody parameter 1 — f3 
(A) is compared with the two well-known network param- 
eters, normalized characteristic length L(p)/L(0) (O) and 
normalized clustering coefficients C(p)/C(0) (□). The data 
points corresponding to the curve for f3 is joined by a solid 
line for better visibility. Network parameters are same as for 
the Fig. The data are average over 10 random realizations 
of rewiring process for each value of p. 



C(0) for the regular lattice. Due to this normalization, 
at p = 0, normalized L and C both are one ; whereas 
for p — > 1, both network parameters will be closer to 
zero. However, [3 behaves completely opposite way at 
the two extreme values of p. Therefore, in Fig. dj we 
compare 1 — (3 with normalized the L and C . This fig- 
ure shows that the (3 and the normalized characteristic 
length L(p)/L(0) display similar trends and strong cor- 
respondence. The most important result of this study is 
that the Poisson^GOE transition and the small-world 
transition take place at the same rewiring probability 
p. Note that all results presented here are for the ad- 
jacency matrices, however we have done similar analysis 



for Laplacian matrices also and for Fig. 



qualitatively same results are obtained [17 1 



3] and Fig. g] 



In summary, we study eigenvalues spacing distribu- 
tions of various model networks and a real-world net- 
work. We show that though the spectral densities of the 
random, the scale-free and the small-world networks are 
different, their eigenvalues spacing distributions are same 
and follow GOE statistics. We also show that spacing 
distribution for a protein-protein interaction network in 



budding yeast follows GOE statistics. Following interpre- 
tation of RMT this universal GOE statistics implies that 
the eigenvalues are strongly correlated among themselves 
because of some kind of randomness in the correspond- 
ing matrix. In network concept this can be considered as 
sufficient amount of randomness or disorder in network 
connections. Furthermore, we study effect of randomness 
in network architecture on the eigenvalues fluctuations, 
and use Brody parameter to quantify this randomness. 
We show that there exists one to one correlation between 
the network diameter, which is a structural property, and 
the Brody parameter characterizing a spectral property. 
We observe that GOE transition occurs at the onset of 
small-world transition. Again, this result implies that at 
the onset of small-world transition, there is some kind 
of randomness spreading over the whole network leading 
to the strong correlations among eigenvalues. The inter- 
esting point here is that a very small amount of random 
connections is sufficient to give rise these correlations. 

Now we point out some of the future prospects of our 
results. Universal GOE behavior of network spectra sug- 
gests that statistics of the bulk of eigenvalues of these net- 
works are consistent with those of a real symmetric ran- 
dom matrix with entries being Gaussian distributed ran- 
dom numbers, and deviation from this could be under- 
stood as system specific part. Random matrix analysis 
of eigenvectors had been performed for various different 
systems [T^], such as stock-market, atmosphere, human 
EEG to extract system specific features by separating out 
universal properties from time-series of these systems. In 
same spirit, one can consider eigenvector analysis of ad- 
jacency matrices to understand system specific features 
in different classes of networks [16| . The system specific 
features could be important nodes, links or anything; but 
the most important outcome of results presented in this 
paper is that we can apply RMT, a very well developed 
branch of Physics, to study networks, providing a com- 
pletely new framework to the complex network research. 
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